Extracting the exponential behaviors in the market data 
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Abstract 

We introduce a mathematical criterion defining the bubbles or the crashes in financial market 
price fluctuations by considering exponential fitting of the given data. By applying this criterion 
we can automatically extract the periods in which bubbles and crashes are identified. Prom stock 
market data of so-called the Internet bubbles it is found that the characteristic length of bubble 
period is about 100 days. 
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INTRODUCTION 



The analysis of bubbles or crashes in financial markets is hot study in econophysics 
. These phenomena are often big social problems like the cases of the Black Monday 
or the Internet bubble. However, the definition of the bubbles or the crashes is not clear so 
far, namely, there is no mathematical definition or criterion formula of these phenomena. 

In order to tackle this problem we pay attention to an empirical fact that an exponential 
curve fits better to bubble or crash data than the popular linear trend lines. By mathe- 
matically describing the exponential fitting we try to propose a mathematical definition 
of bubbles and crashes, so that we can automatically specify the period of a bubble and crush. 

In this paper we analyze the high-frequency NASDAQ data focusing on the Internet 
bubble or the dot-com bubble appeared at the end of 20th century. We calculate an average 
of prices every thirty seconds in the tick data. Regular trading time in NASDAQ is from 
9;30 to 16;00, so the number of data points in a day is 780. 

EXTRACTION OF THE EXPONENTIAL BEHAVIORS 

We introduce the following formula for extracting the exponential behaviors in the finan- 
cial time series. 

P(t) - P (*; r<) = T){P(t - 1) - P (t; Ti)} + F(t) (1) 

This formula has an autoregressive form where the current state is given by the past states. 
In this formula, P(t) is a price at time t, &i(i;Ti) is the parameter characterizing the 
exponential behaviors in the i-th period of length Ti, If oj\(i; T) is larger than 1.0, the time 
series are either exponentially increasing or decreasing, then P (i;Ti) gives the base line 
of these exponential divergence. If uji{i\Tj) is less or equal to 1.0, it means that there is 
no bubble-like trend or the time series is convergent, then P (i;Ti) shows an asymptotic 
line. F(t) is residual noise term. The parameters o>i(i;Tj) and Po(i;Tj) can be determined 
uniquely under the condition that minimizes the errors, which is the sum of squares of F(t). 
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ESTIMATION OF THE OPTIMAL PERIOD 



For applying Eq.(l) to the time series, we need to estimate the length of the period Tj 
that can be fitted by an exponential function. We introduce a minimum period of Tj by 
using the following well-known auto-regressive (N) model for the price difference time series. 



j=N-l 

AP(t) = £ b ] AP{t- ] ) + f{t) 

3=1 

AP(t) = P(t)-P(t-1) 



(2) 
(3) 



Here, bi give the AR parameters that make the residue, /(£), almost an independent random 
noise jj, U, |^ . In this equation we tune the parameters of AR so that the standard deviation 
of f(t) as similar as possible to the real stock price data such as Yahoo! Inc. (ticker symbol 
YHOO). Now we define the time scale of Tj by the minimum time scale that satisfies the 
condition where U\(i\ Tj) is always less or equal to 1.0 when the time series are created by the 
Eqs. (2) and (3) with N=5. Actually, by changing Tj from 1 day to 100 days, the frequency 
of finding u)\(i\ T) larger than 1.0 decreases. When we set Tj to be longer than 100 days, we 
cannot observe Tj) to take a value larger than 1.0 in practical sense. Therefore, we fix 
the optimal time scale Tj for observing the exponential behaviors to be 100 days. On the 
basis of this AR analysis, if we observe u>i(i; Tj) larger than 1.0 in the time range of 100 days 
in real data, we can say that the real time series fluctuation of that range is statistically 
different from the AR model which implies that a non-stationary description is needed. 
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FIG. 1: The time series of u)i(i;Ti) with Tj =100 days, (a) The case of YHOO (b) Random walk 
based on AR(5). 
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ASSIGNMENT OF BUBBLE, CRASH AND CONVERGENCE 

We now assign each time step (one time step is thirty seconds) either exponential or 
convergent. If the observing box of 100 days is judged as exponentially diverging, that means 
u)i{i;Ti) is larger than 1.0 in the box, we assign all time steps in the box as exponential. 
Then, we shift the box by one time step, and calculate u>i(i; Ti) for the new box. If the value 
of Ui(i; Tj) is less than 1.0, then only the latest time step is assigned as convergent. Repeating 
this process to cover all the data we can separate the exponential periods and convergent 
periods, see Fig. 2. At this stage the length of each period takes any value independent of 
the observing time scale Tj. Note that we can detect the start of slow exponential behavior 
before the extreme price fluctuations as found in Fig.3. 
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FIG. 2: The exponential trend curves and Po(i;Ti) in each period. Time series of YHOO (dotted 
line). The bubble periods (heavy line) are A and C. The crash period (heavy dashed line) is E. 
The convergent period (line) are B, D and F. 

Next, we calculate the parameters uj\(i\ Ti) and P (i; Ti) to each period by applying Eq.(l) 
again. Then, we can draw an exponential trend curve for each exponential period as shown 
in Fig. 2 by using the following equation. 

Ptrendit) = Ti)P trend {t - 1) + (1 - UJ^l] T$)P {i\ Ti) (4) 
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FIG. 3: The time series of a price and u>i(i;Ti) in the scale from the end of the period B to the 
beginning of the period D. The vertical dotted line shows that the first point of detecting the 
bubble. 

In this equation Pt re nd(t) is the exponential trend price at time t. When the exponential 
trend is diverging upward we call it as "bubble", when it is diverging downward it is called 
as "crash". When the trend curve is converging we call it as "convergence". The starting 
value of this price in each period is derived from theoretical calculation. From Fig. 2 we find 
that the exponential behaviors are continuing more than 250 days in the period A. A critical 
case may be the period D. As this period starts with a sharp drop, it may intuitively look 
a kind of " crash" , however, according to our analysis the trend line shows a convergence to 
a lower price. 

In Fig. 4 we compare the error estimation between our exponential approximation and the 
usual linear approximation in each period. The errors E(i) are calculated by the following 
equation. 



The linear approximation is determined by the least-square-method. We can find that 
errors become smaller for exponential approximation compared to the linear approximation 
in cases of the bubbles or crashes (the periods A,C and E). 




(5) 
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The residual error F(t) in Eq. (1) is not perfectly uncorrelated because just extracting 
the exponential trends in big scale can not extract all local trends. In order to separate pure 
noises we apply the Yule- Walker formula for the time series of F(t) 



j=N-l 

F(t)= £ aj (i;T^F(t-j)+N(t) 

3=1 

Then, Eqs.(l) and (7) make the following equation. 



(6) 



P(t) = £ TjP(t - j) + (1 - E mPoii; T t ) + N(t) (7) 

3=1 3=1 

In this equation flj(i;Ti) is written by the following forms. 

Cli(r,Ti) = a^Ti) +ui(i;Ti) (8) 
Ti) = aj (i; Ti) - flj -_i(i; T^i; (2 < j < N - 1) (9) 

Sl N (i;Ti) = -aN-^i-T^ii-Ti) (10) 

Here the noise term N(t) is confirmed to be nearly perfectly uncorrelated. 
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FIG. 4: Comparison of the errors E(i) in each periods. Exponential approximations (circles) and 
linear approximations (triangles). 
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CONCLUSION 



In this paper we have mathematically defined bubbles and crashes by the exponential 
behaviors. As we have discussed in proceeding section this method can be used for prediction 
of large price changes in macroscopic scale. However, the predictive information in our 
method is not enough, for example, we can not tell when a bubble will stop. As a future work 



we are now combining the potential analysis methoc 



to clarify the mechanism of bubbles and crashes 
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